Verification  of  DSMC  Simulations 
Using  Spectral  Analysis 


A 


U.S.  AIR  FOR§H 


SAMUEL  J.  ARAKI  AND  ROBERT  S. 

MARTIN 


ERC  INC,  AIR  FORCE  RESEARCH  LABORATORY 
EDWARDS  AIR  FORCE  BASE,  CA  USA 


DSMC  CONFERENCE,  KAUAI,  HAWAII,  USA 
SEPTEMBER  13-17,  2015 


DISTRIBUTION  A:  APPROVED  FOR  PUBLIC  RELEASE; 
DISTRIBUTION  UNLIMITED 
AFTC/PA  CLEARANCE  NO.  TBD 


v  Outline 


•  Introduction 

•  Test  Problem 

•  Chi-Square  Test 

•  Spectral  Analysis 

•  Conclusion  /  Future  Work 


S.  ARAKI  (AFRL/RQRS) 


DISTRIBUTION  A:  APPROVED  FOR  PUBLIC  RELEASE;  UNLIMITED  DISTRIBUTION 


1  /? 


TURF: 

Thermodynamics  Universal  Research  Framework 


•  Unifies  multiple  research  codes  from  group 

-  Models  of  spacecraft  propulsion  relevant  plasma  at 
different  spatial  scales  (lpm-lOOm) 

•  Single  fluid  Magnetohydrodynamics  (MHD)  solver 

•  Unstructured  multi-fluid  solver 


•  Vlasov  solver 

•  Particle-In-Cell  (PIC)  with  DSMC 

-  Combined  redundant  functionality  in  those  codes 

-  Unified  GPU  support 


Field  Reversed  Configuration 
Plasma 
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Motivation 

•  Multiple  developers  of  TURF 

-  Changes  to  core  class  objects  required  by 
one  model  can  break  the  others. 

-  Merging  different  heads  and  making  sure  all 
the  models  work  properly 

•  Automated  test  suites  for  different 
models 


Multiple  heads  in  Mercurial 


Objectives 

•  Set  up  simple  problem  for  testing  DSMC  part  of  TURF 

•  Development  of  efficient  procedure  in  verifying  the  results 
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•  Standalone  DSMC  code 
run  on  GPU 

•  Initial  State 

-  Upstream  and  downstream  flow 
properties  according  to  Rankine- 
Hugoniot  relations 

-  Discontinuous  profile  at  t=0 
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Requirements 

•  Fast  simulation  (at  least  <  5  hours)  —  less  particles 

•  Smooth  solution  —  more  particles  and  time-steps 

Baseline  inputs:  (40  mins) 

•  8,000,000  Ar  particles,  10,000  time-steps,  1,000  sampling  cells 


Axial  Position,  mm  Axial  Position,  mm 


How  can  we  systematically  accept/reject  results  ? 
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1.  Run  the  test  problem  M 
times  with  different 
random  number  seed 


2.  Deviation  of  results  is 
expected  to  fall  under 
normal  distribution 


f(x,ju,C r) 
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Normalized  Value 


Chi-Square  Test:  Standard  Deviation 


\  k 


3.  Determine  point-wise  expected  value  (/J)  and 
standard  deviation  (a)  for  N  cells 
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4.  For  a  given  run,  deduce  a  global  parameter  (%)  using 
pi  and  a 
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*  All  runs  performed  with  the  same  RNG  seed 
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•  Plots  of  two  normal  distributions  for  different  VSS 
diameter 

-  The  mean  of  one  distribution  is  larger  than  the  other  with 
larger  cross-section,  but  some  portion  of  it  should  still 
overlap 


Distribution  overlaps... 

Could  we  effectively  identify  the  distribution  given  a 
value  in  the  overlapping  region? 


Remove/reduce  statistical  noise 
•  Run  more  particles  and  time-steps? 
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Normalized  Value 


Spectral  Analysis:  Difference  Profiles 


Perform  analysis  in  frequency  space 

•  High  frequency  mode  —  Purely  statistical 

•  Low  frequency  mode  -  Comes  from  perturbed  input 


Axial  Position,  mm  Axial  Position,  mm 
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Spectral  Analysis:  FFT  on  Difference  Profile 
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Smaller  low  mode  amplitude  as  approaches  the  true 
input  solution 
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Spectral  Analysis: 

Distribution  of  Low-Mode  Amplitude 


How  do  we  deal  with  outliers. . .? 
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•  Need  to  pass  the  runs  with  outliers 

-  What  is  the  probability  of  outliers  occurring  multiple  times 
on  the  roll? 

•  Probability  of  one  outlier:  1% 

•  Probability  of  outliers  three  times  on  the  roll:  (1%)3 

•Use  geometric  mean  to  obtain  the  global  spectral 
amplitude 
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Conclusions 

•  Chi-Square  test 

-  Width  of  distribution  is  determined  by  the 
statistical  noise  inherent  to  particle  simulations 

•  Spectral  analysis 

-  Strongly  effective  in  the  test  problem 

-  Essentially  removes  the  effect  of  statistical 
noise  in  the  test 


Future  Work 

•  Use  the  methodology  in  other  DSMC  problems  to 
study  the  strength/weakness  of  the  procedure 

•  Apply  the  knowledge  in  smoothing  of  flow 
properties 
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Thank  you 
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1.  Perturbing  the  VSS  diameter  narrows  /widens  the 
shock  width 

2.  Difference  profile  contains 

1 .  Low  frequency  mode  from  wrong  input 

2.  High  frequency  mode  from  statistical  noise 

3.  Perform  Fast  Fourier  Transformation  (FFT)  on 
difference  profile 

4.  Observe  the  amplitude  of  low  modes 

5.  Perform  boosting 
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